Proximity effects in a topological-insulator/Mott-insulator heterostructure 
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We investigate proximity effects in a correlated heterostructure of a two-dimensional Mott insula- 
tor (MI) and a topological insulator (TI) by employing inhomogeneous dynamical mean-field theory. 
We show that the edge state of the TI induces strongly renormalized mid-gap states inside the MI 
region, which still have a remnant of the helical energy-spectrum. The penetration of low-energy 
electrons, which is controlled by the interface tunneling V , largely enhances the electron mass inside 
the MI and also splits a single Dirac-cone at edge sites into the spatially-separated two Dirac-cones 
in the strong V region. 
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Remarkable progress has been made in the study of 
the topological insulator (TI) as a new class of materials 
characterized by an energy gap in the bulk but gapless 
edge (surface) states at its boundarjsi"— . In recent ex- 
periments, the observation of such TIs is reported for 
HgTe/CdTe quantum wells^— and some bismuth com- 
pounds (such as Bi2Se3 and Bii_^Sba;) correspond- 
ing to two- and three-dimensional TIs, respectively. Edge 
states of TIs are protected by non-trivial topological 
properties of the electronic bulk spectrum, thereby be- 
ing robust against small perturbations conserving time- 
reversal symmetry, such as non-magnetic impurities^. 
Hence, as long as the bulk gap exists, the low-energy 
physics of the TI is dominated by the edge states. 

Heterostructures involving the TIs are currently the 
subject of intensive studies as they might have applica- 
tions in future spintronics devices. They also provide 
a versatile platform for searching exotic interface phe- 
nomena, such as Majonara bound state a^'^d^ and anoma- 
lous magnctoresistancei^. In particular, we would like 
to explore the interface physics which emerges in a het- 
erostructure composed of a TI and strongly correlated 
materials, since the previous studies of TI have mainly fo- 
cused on heterostructures involving non-interacting elec- 
trons. 

Regarding heterostructures with electron correlations, 
recent years have seen tremendous advances in produc- 
ing high-quality interfaces composed of various materials 
such as band-insulator/Mott-insulator (BI/MI) or differ- 
ent types of band insulators. Unusual properties have 
been discovered at these interfaces, such as strongly con- 
fined metallic phases^^, magnetisroi^, and superconduc- 
tivityi^ to name a few. The occurrence of a metallic 
interface through electronic rearrangement is one of the 
intriguing features of the BI/MI heterostructures^^"— . 
Naturally we may ask how the situation is modified when 
the band insulator is replaced by a topological insulator 
(TI). The interface metallic state should be influenced 
by the presence of topological edge states and the inter- 
play between such edge states and the strong electron 
correlation can give rise to novel physical properties. 

In this study, we analyze the electronic properties at a 



two-dimensional heterostructure consisting of a paramag- 
netic Mott insulator (MI) and a TI, by using a rather sim- 
ple microscopic model for both insulators of TI/MI het- 
erostructure considering onsite Coulomb repulsion but 
ignoring long-range interactions. The electronic corre- 
lations are treated by dynamical mean-field theory^ so 
that we can follow the renormalization of quasiparticles 
penetrating the MI and their interplay with the nearly 
localized degrees of freedom of the MI. We will eluci- 
date how the important parameters such as the (onsite) 
Coulomb repulsion and the coupling (hopping) between 
the two insulators influence the metallic quasiparticle 
states. 

The model describes a two-dimensional single- 
quantum-well geometry (square lattice) composed of a 
TI sandwiched by identical paramagnetic Mis on both 
sides. In view of the fact that our TI is based on a two- 
orbital model, introduced below, we choose also for the 
MI a configuration of two independent bands at half fill- 
ing with strong Coulomb repulsion. The Hamiltonian is 
decomposed into H = Hti + J2i=R l(^m + ^v) '^^^'^ 
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Here, (-^m) denotes the Hamiltonian for the MI 

on the right (left) edge of the TI region, and the cou- 
pling between these regions is implemented by the hy- 
bridization matrix, (Hy). The parameters ta and 
Va are the hopping integrals for orbital a. We assume 
ti = —t2 = —t and Vi = —V2 = —V for simplicity. The 
fermion operators c\^^ and a\^^ {ciaa and aio-a) create 
(annihilate) a spin a =1,4- electron of orbital a = 1,2 
at site i on the square lattice. Note that Ciaa and diaa 
operate on the orbitals for MI and TI, respectively. 

For the TI region we introduce a generalized Bernevig- 
Hughes-Zhang (BHZ) model^^, given by H^i = iJenz + 
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'^Ti Y.ia fiitaniia, where 

[i<T(<5)]„^aj^/3, (3) 



t<r(±a;) 



ti ± iatso 
±iatso t2 



Here, to- ((5) with S = ±a; (±y) denotes the spin dependent 
hopping integral along the x (y)-direction. We assume 
€i = —62 ~ —t in the following. The topologically non- 
trivial phase is driven via the finite inter-site and inter- 
orbital hybridization tso for < [ei| < At. 

For our calculation we set the width of the TI (MI) re- 
gion to 20 (10) unit cells along the y-direction, while the 
system keeps the translation symmetry in the .T-direction. 
Unless otherwise mentioned, <so and V arc fixed to 0.25t 
and respectively, and the spin index a is dropped. 
Throughout this paper, we restrict ourselves to zero tem- 
perature and half filling {{fii) = X]o-a(^ica) = 2). 

We note here that correlation effects in TIs have been 
studied extensively, also suggesting that the strong elec- 
tron correlation disturbs the topological nature^^"— and 
even induces topological phases without gapless edge 
states^^. Thus we may ask how the correlation effects 
manifest themselves at TI/MI interfaces. This is the cen- 
tral issue in the present paper. 

In the following, many-body effects in the above Hamil- 
tonian arc treated within the inhomogencous dynamical 
mean-field theory (IDMFT)iii2ai^i2^, which solves the 
y-dependent self-energy as a diagonal matrix with self- 
consistent equations. 
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where, Gai3{y,y';k^,u;) and Qoapiy.y']^^) are the lat- 
tice and cavity Green's functions, respectively. Note 
that we treat this system as a spatially modulated two- 
dimensional system with a finite strip width, following 
the treatment done in Ref. [2^. 

The local self-energy for the quantum impurity model 
is obtained using the exact diagonalization methods^^, 
suitably extended for the IDMFT analysis^. To avoid 
time-consuming numerics, we neglect the inter-band self- 
energy, Ei2(y;a;) and E2i(y;a;). The validity of this ap- 
proximation has been discussed in Ref. [l^ Here, we em- 
ploy the Lanzcos algorithm to solve the local Green's 
function, and the bath parameters for the finite-size sys- 
tem arc obtained by minimizing the following function^S; 
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Go (y; iwn) - ^0 (y , y; jw„) I 
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where, Go^{y', i^jJn) is the non-interacting Green's func- 
tion of the impurity model for the discretized Matsubara 
frequency a;„ — {2n + l)7r//3 on chain y. We choose the 
number of the bath levels coupled to each band to rib = 7, 
and fix the inverse imaginary temperature /3 = 200. 
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FIG. 1: (a) The orbital-resolved local spectral-function 
Aa{y;uj) for MI region (left half of the system) with Um = 
13.3t and Uti = U. The TI (MI) regions correspond to y > 
(j/ < — 1), and the solid and dashed lines indicate Ai and A2, 
respectively. Plots of the corresponding momentum-resolved 
spectral functions: (b) at y = (Tl-edge) with both spin 
states and (c) at y = — 1 (Ml-edge) restricted to up-spin state 
only, (d) The spectral function (^1 + A2) around zero fre- 
quency inside the MI region near y = 0. The curves from top 
to bottom in the vicinity of zero frequency correspond to the 
spectral functions ai, y — —1, —2 and —3, respectively, (e) 
The same as in (d) for the interface of a trivial BI and Mis 
for y = —1 (solid line) and y = (dotted line). 



Figure [U^a) shows the orbital-resolved local spectral 
function Aa(y;uj) = — (l/7r)ImGaa(y)y;w -I- i(5) for the 
MI region with Um = 13. 3t and Uti = 4t. Note that the 
strength of Um is slightly larger than the critical value 
Uc ^ 13. 2t for Mott transition in the bulk, while the 
strength of Uti is small enough to realize the non-trivial 
topological phase inside the hetcrostructurc (0 < y < 
19)^. In this figure, we follow the evolution of the edge 
state in the energy gap when approaching the Tl-edge 
{y ~ 0) from y ~ 3, whose existence is characteristic of 
the interface between topologically trivial and nontriv- 
ial materials. Actually the momentum-resolved spectral 
function, A{y]kx,u!) = ~{l/Tr)J2a^^C!aaiy,y;kx,i^ + 
iS), displays the edge state at ?/ = in Fig. [T] (b). The 
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edge state penetrates also into the MI region and in- 
duces a narrow band of mid-gap states. Figures [1] (c) 
and (d) show the momentum-resolved spectral function 
for up-spin states and the quasi-particle peak around 
u! ^ for y < —1, respectively. While the width of 
quasi-particle peak rapidly decreases away from y = 
in Fig. [T] (b), the existence of the renormalized quasi- 
particle states in the depth of the MI region is con- 
firmed through the non- vanishing renormalization factor 
Z{y) = [1 — 5^ImE(y; ia;)]~^g. In addition, the energy 
spectrum describes the antisymmetric behavior across 
kx = TT, which implies that a heavy-fermion-like mid- 
gap state for y < —1 is induced by the penetration of the 
helical edge state. This scenario is further underlined 
by Fig. [T] (e), where the TI is replaced by the trivial BI 
with the same gap-size as the present TI. In this case, 
the heavy quasiparticlcs in the MI no longer exist, in 
contrast to the MI/TI interface. We also confirm that 
once the topological order is destroyed via the strong 
on-site Coulomb repulsion Utt^, the spectral-weight for 
the mid-gap state simultaneously goes to zero (not shown 
here). 

The formation of renormalized mid-gap states is un- 
derstood in terms of a "Kondo-type screening" mech- 
anism between spin states in the MI and helical edge 
states. In the MI region, spin excitations are gapless, 
which appear as essentially localized free spins in the 
DMFT treatment. Such free spins are screened by he- 
lical edge states forming a Kondo-type resonance and es- 
tablishing strongly renormalized mid-gap states in the 
first few layers of the MI. In this sense, the MI/TI in- 
terface effectively realize a Kondo lattice system with 
helical conduction electrons. Similar proximity effects 
can also be found in the studies of the Ml/metal het- 
erostructure^Si^. However, the distinctive difference be- 
comes visible in Z{y) around the interface. In the present 
case, the Kondo-type screening is driven only by heli- 
cal edges states, so that the resulting mid-gap electron 
states become much heavier than that for Ml/metal in- 
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FIG. 2: The quasi-particle weight Z{y) at j/ = —1 as a func- 
tion of Um with tso/t = 0.1, 0.2, . . . 1.0 (increasing from top to 
bottom), fixing Z{9) — 0.8 ± 0.001. Inset: comparison of the 
corresponding Z{y) at y — —5 (triangle) and y — —1 (square) 
for tso = 0-Gt. 
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FIG. 3: (a) The V dependence of the renormalization fac- 
tor Z{y) with Um = 13. 3t and Uti ~ The square and 
circle symbols represent the Z{y) at y = —1 and y — —2, re- 
spectively; we note that Z{ — 2) is enlarged 20 times, (b) The 
corresponding local spectral function: the left (right) panel 
for y = -1 (y ^ 0). 



terfaces. It originates from the band-insulating nature 
of the TI with the energy gap Aso, because in inhomo- 
geneous correlated systems, the electron renormalization 
occurs strongly on their surface due to the reduced co- 
ordination number— Hence, it is naturally expected 
that the renormalization of the mid-gap state is closely 
related to the gap size Ago ^ AZts^r^. Figure [3] in fact 
shows the monotonic suppression of Z{y = —1) against 
the increase in tgo- The inset of this figure also con- 
firms the strong correlation effects around the interface 
for weak Um, while this behavior is inverted for large Um 
where the penetration of the edge state mainly controls 
the spatial modulation of Z{y). 

To get further insight into the mid-gap state, we now 
focus on the effect of interface electron tunneling V 
between the TI and MI regions. We present the V- 
dependence of the renormalization factor in Fig. [3] (a), 
where the change in the slope of Z{—2) is found, in spite 
of the monotonic evolution of Z{—1). This correlation 
enhancement for y = —2 can be understood as the band 
reconstruction at the interface: the formation of a dimer- 
ized state between y = — 1 and y — 0, whose energy gap 
is roughly given by A - 2V Z{'-1)Z{0)SM1. In the 
present system, A exceeds the band width of the edge 
state (~ Ago — t) above V/t ^ 1.8, which explains the 
F-dependence of Z{~2) in Fig. [3] (a) [see also Fig. H (c)] . 
In Fig. [3] (b), we further show the evolution of the en- 
ergy gap around a; for y = —1 and y ~ 0. As 
anticipated, in both cases the gap structures are formed 
around V/t ~ 2.5 and the gap size monotonically grows 
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FIG. 4: (a) The momentum-resolved spectral function 
A{y; kx,uj) for j/ = — 1 (left), j/ = (center) and y = 1 (right) 
with Um = I3.3t, Uti = 4f. Here A(-l;A;^,cj) for V/t = 1.0 
(left top) and A{0;kx,uj) for V/f — 3.0 (center bottom) are 
enlarged 5 times, (b) The corresponding helicity Tj{y) defined 
in Eq. |6] as a function of y with several values of V/t. (c) 
The 1/dependence of ri{y) for y — 0, ±1 (left axis) and the 
dimerization gap A = 2V y^Z( — l)Z{0) (right axis). 



with increasing V. 

All important question is how the topological edge 
state at y = depends on the dimerization between 
y = —I and y = 0- To this end, in Fig.|l](a), A{y;kx,io) 
for y = 0, ±1 is plotted along the = tt/2 to 3tt/2. 
From the result we see that the spectral weight for the 
edge sites of the TI {y ~ 0) is gradually suppressed as V 
increases. On the contrary, the magnitude of A{1; k:c,Lu) 
shows an upward turn across V/t ^ 2.0, and above 
V/t ~ 3.0 we find the characteristic k^ dependence of 
A{l;kx,to) which is identical to that of A{0;kx,io) at 
V/t = 0. Thus we conclude that in the limit V —?' oo, 
the edge state shifts its position from y = to y = 1. 

More closely looking at the bottom panels of Fig. 0] 
(a), we find that the edge state exhibits an anomalous y- 
dependence: due to electron tunneling along y-direction, 
the magnitude of the Dirac-cone dispersion is expected 
to monotonically decrease away from y = 1, but the ob- 
tained spectral- weight at y = — 1 even exceeds that at 



y = 0. This indicates that there exists two Dirac cones 
at y = ±1. Since the edge state should be localized at 
y = 1 in the strong V limit, we refer to the Dirac cone 
at y = —1, which looks like a copy of the edge state at 
y = 1, as a topological shadow edge-state (TSE). 

We can characterize the edge states in the TSE by 
introducing the helicity function rjly) defined as, 



l<^l<Aso 



dujdkx I , , 



A|(y;a;,fc^)|, (6) 



where A^ is the spectral function {Ai + A2 ) with spin a 
and the w-integral is limited within the gap Aso = 4Ztso- 
We emphasize that rj{xf) in Figs.|3](b) and|3](c) shows the 
good correspondence to the edge-state behavior in Fig. |4] 
(a). Until the dimerization gap opens for V/t ~ 2.5, 
the magnitude of ??(—!) increases while that of 77(6) de- 
creases with increasing V, as shown in Fig. |4] (c) [see 
also Fig. |3Ia)]. This may be understood in terms of 
the topological band-reconstruction. For relatively larger 
values oiV/t < 2.5, the energy spectrums at y = — 1 and 
y = are strongly hybridized with each other, which ex- 
tends the topologically non-trivial band-structure toward 
y = — 1. In this sense, the sites at y = — 1 rather than 
y ~ shall be regarded as the edge of the TI. We note 
that when V further increases, the edge state should shift 
its position from y = — ltoy=l. Therefore, the TSE 
for V/t ~ 3 can be understood as the remnant of this 
displacement, as plotted in Fig.|l](c). 

To summarize, we presented the DMFT study of 
a minimal model for the heterostructure of the two- 
dimensional TI embedded in the Mis. Our results showed 
that the helical edge state at the end of the TI pen- 
etrates into the MI, even if the Hubbard gap is very 
large. We clarified that such proximity effects induce the 
strongly renormalized mid-gap state having a remnant of 
the helical energy spectrum inside the MI region. It was 
found that the correlation effects around the interface 
are strongly enhanced due to the spin-orbit gap in the 
TI region. We also demonstrated how the hybridization 
between the TI and MI affects the electron penetration, 
and found the enhanced correlation effect and the ex- 
istence of the TSE inside the MI, driven by the band 
reconstruction at the interface. 
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